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(57) Abstract: Methods are described for the production of a 
three-dimensional reconstruction of a undeformed object from 
two different views of the object under deformation using a 
volume constraint and also by matching corresponding features 
in the two images. The volume constraint involves assuming that 
the deformed volume is the same as the undeformed volume, 
and calculating the deformed volume from one of the images. 
Further, the deformation of the object can be parameterised by 
finding corresponding image entities in the each of the images. 
The method is particularly applicable to breast mammograms in 
which case the two images are the cranio-caudal (CC) image and 
medio-lateral oblique (MLO) image whose angular separation 
varies from 35 to 60 degrees. The image entities which are 
detected in the two images are microcalcifications, and these 
are matched by detecting a value, representing their volume and 
looking for matches in this value between the two images. 
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THREE- DIMENSIONAL RECONSTRUCTION OF A BREAST FROM TWO X-RAY MAMMOGRAMS 



5 The present invention relates to a method for producing a three-dimensional 

reconstruction of an object from two different images of the object In particular it 
relates to the case where the two images, taken from different angles, are of the 
object under deformation, and what is desired is a three-dimensional reconstruction 
of the undeformed object. 

10 In an increasing range of applications, and in particular in medical image 

analysis, there is a requirement to analyse images of objects that are deformed. For 
instance, the diagnosis of breast cancer almost always involves X-ray mammograms 
being taken of the "compressed" breast. In the case of X-ray imaging, in which the 
absorption of X-rays can be harmful to tissue, the breast is compressed in order to 

15 reduce to a minimum ±e possibility of harm to the patient. The breast is compressed 
between an upper compression plate and a lower plate which consists of the film- 
screen cassette. Although the term "compression" is typically used in this field, in 
fact it is more correct tc refer to "deformation" because the breast is essentially 
incompressible and so i.s volume does not change. In order to construct a three- 

20 dimensional reconstruciion of the breast it is necessary to combine images taken 
from different view directions in order to overcome the loss of information by the 
projective nature of the triage. Typically two views of each breast are taken, namely 
a cranio-caudai (CC) in. je ("head to toe") and a medio-lateral oblique (MLO) 
("shoulder to the oppos.;e hip") image, or the CC and lateral-medial (LM) image. 

25 The angular separation between these views varies according to the woman's 

size. The angle of the r.vedio-lateral obiique mammogram is at the radiographer's 
discretion but is typical. y between 35 and 60 degrees, though this angle is not 
routinely noted down. V;-uaily, short, stocky women are imaged with angles less 
than 45 degrees, whilst thin women have angles over 45 degrees. It also is 

30 important to noce that the degree of compression of the breast is significantly 

different between the tv o views. For instance, the compression for the CC view may 
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be 5 cm and the compression for the MLO view 6 cm. 

These variations makes three-dimensional reconstruction a very difficult 
problem. A considerable amount of work has been done in the field of stereo vision 
in general and this has produced a number of algorithms that can be used to make 
5 three-dimensional reconstructions from different images. However, much of this 
relates to so called "narrow angle stereo vision" in which the angular separation 
between the two images is often less than 10 degrees. In such a case most image 
points in one pair of stereo images have a counterpart in the other and for each small 
region in the lefthand image there is a closely similar region in the right hand image. 

10 However, this does not apply in the case of X-ray mammograms where the angular 
separation is much larger. 'Furthermore the substantial, and different, compression of 
the breast in mammography means that points in one image which correspond to a 
given point in the other image do not lie along a straight line as in normal narrow 
angle stereo vision. Thus the algorithms used in narrow-angle stereo vision are not 

15 useful in reconstruction from mammograms. 

Some proposals have been made for combining wide-angle views, but these 
are based on a rigid body transformation between the two views, which is clearly not 
the same for mammograms for different compressions, and also assumes that the 
scene can be modelled using a simple geometry using polyhedra, which again is not 

20 suitable for mammography. 

In the field of mammography proposals have been made to allow the 
matching of the same view of the same breast, at two different times (essentially just 
comparing two time sec .-.rated images) or the same view of the two breasts at the 
approximately the sam„- hme, cut again compression is not considered nor the 

25 matching of views fro:v ilfferi.nt angles. A technique known as tomosynthesis has 
been proposed which i:. . :!ves holding a breast in one position and translating an X- 
ray tube to a sequence l :" ..iffert;:: petitions along a straight line trajectory. 
However, this does not ....-:e into account the compression problem, nor does it enable 
the reconstruction of a 're dinvensic.-.a! model of the breast from existing CC and 

30 MLO views. Given thai lillic/.s of pairs of stored CC-MLO views are available, it 
would ':-e very useful t:. r -~ able :o provide a three-dimensional reconstruction from 
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those two views. 

The paper by T. Miiller er. aL "Volume reconstruction of clustered 
microcalcifications in mammograms"; Digital Mammography, pp.32 1-328, Kluwer 
Scientific Publishers, 1998 requires the user to identify corresponding 
5 microcalcifications in each of the CC and MLO images and it then suggests 

modelling the different compression between the two images as a uniform scaling of 
one of the images. However this leads to a uniform (affine) transformation between 
the two images which is a very poor approximation to the varied transformation 
across'the CC image, corresponding to different anatomical structures. 
10 A different technique for CC-MLO matching and uncompression of a breast 

has been proposed by Kita, Highnam and Brady in "Correspondence between two 
different views of X-ray mammograms using simulation of breast deformation"; • 
Proceedings of CVPR t 1998. 

In this technique, as illustrated schematically in Figures 1 and 2 of the 
15 accompanying drawings, first, the outlines BO of the breast and the nipple positions 
10 from both the CC and MLO image are detected manually as shown schematically 
in Figures 1 A and B. A number of techniques are available to do this, for example 
the breast outline can be found on the basis of quantum noise characteristics inside 
the breast and on the film. Once the outlines and nipples are detected, the 3-D 
20 uncompressed breast shape is then reconstructed automatically by aligning the two 
outline: at the nipple position in the 3-D coordinate frame such that the CC and MLO 
outlines tie/respectively, on the horizontal and vertical plane, and intersect at the 
nipple position as shown in Figure 2. On each plane parallel to the chest wail, four 

estimated points, ?\° , ;°? C , P^ 0 and P } ?~° , on the breast surface are 

25 obtained, twc ta.:h fro:.: t/.e CC and >-2_0 outlines. The remainder of the 

uncompressed c: as: s\:rfa:e is ti:^n m; celled as pan of a parametric surface, for 

exampl i an ellip j j Zj 9 pas.ing :/.:oug:: each pair of estimated surface points, P i 

and when- /s {1,7}. 

Figure 3 rhows a schematic cf a cross-section of the CC compressed breast 
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accordingtc Kira e: al's model. The dashed curve PIP4P7 represents the 
uncompressed breast outline, which is taken as one of the slice cross-sections of the 
3-D reconstructed breast. The solid line segments PIP2, P2P3, P3P5, PSP6 and 
P6P1 represent the compressed breast outline. The compressed breast thickness, H, 
5 can be measured or estimated using a model-based algorithm such as that given in R. 
P. Highnam and J. M. Brady; "Mammographic Image Processing", Kluwer 
Academic Publishing, 1999. 

Assuming that the oreast surface stretches (or shrinks) by a constant factor 
under "(un)compress ion, a point P u on the uncompressed breast outline can be mapped 

10 to point P u on the compressed outline using simple ratio, and likewise for points P t 

and P t . Points in the mid-plane, i.e. z = G plane, are assumed to remain undeformed 

under (un)compression. Thus, P s remain's in the same coordinate position after 

compression. Finally, curves P C P U and P c P f are modelled by quadratics. Using 

these assumptions, ever/ point in the 2-D CC image has a corresponding curve in the 
15 3-D uncompressed breast ifter simulation of uncomprsssion (as can be seen in Figure 
9 by comparing poin; 90 in the MLO and CC views of Figure 9A with the 
corresponding curve? 92, 14 in :he uncompressed reconstruction of Figure 9B). 

However, there arc problems with this approach. The compressed outline is 
used in :he reconstruction, but this does not take into account the deformation of the 
20 breast edge under ccmprencion, and actually results in a reconstructed breast which is 
much larger than the acruai one. Further no account is taken of variation in the 
compression through the breast structure. 

The p: rsent i..ve:::i jn is directed to improving the production of a 3-D 
reconstr.:c;icn from two v' .ws c-f a deformed object. 
25 In more detail, a f;r.:t aspect of the invention provides a method of producing 

a three dimensional rep/e; .ntaticn of an undeformed object by combining 
information from two ima- es taken from different viewpoints of the object under 
deformation, estimating volume of the deformed object, and constraining the 
three dimensicnal m Az\ the object to have substantially the same volume. 
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The deformation of the object may differ between the two images and the 
volume of the deformed object may be estimated from one of the images, for instance 
by summing over the in: age the volume of slices of the object parallel to the imaging 
direction. This may involve estimates about the shape of the surface of the deformed 
5 object 

The information from the two views can be combined by detecting the 

outlines of the object, reducing the areas outiined by a predetermined amount and 

using the reduced areas is profiles for the reconstruction. This may be performed in 

an iterative process Li which the volume of the reconstruction is compared to the 
10 volume of the deformed object and the areas successively reduced until the 

reconstructed volume is substantially equal to the volume of the deformed object. 

The amount of reduction cf the areas can be different in the two views in accordance 

to the differing deformations between the two views. 

The invention = :so provides a method of parameterising the deformation of an 
15 object using at least cne of the parameters of: the linear displacement of the interior 

of the object, the rotational displacement of the interior of the object, and the 

stretching of the surface under the deformation. 

Where the defo: :r.a:ion cf the object differs between the two images, the 

parameter representing :..e stretching of the surface may be calculated for each of the 
20 images. The param-j:e:: m:.y be calculated by detecting corresponding entities in the 

two image entities and : -tting the deformation parameters to bring the corresponding 

image entities into regii .ration ;a the three-dimensional representation of the 

undeformed object. 

It will be appr. : ted thct tnese methods are particularly applicable to 
:5 reconstruct: ens of th- .. .nan breast from breast mammograms for instance CC and 

MLO or L:v; imagec. :!:..: cn.;e t..e corresponding image entities used for setting 

the parameters can L. n. :rc:ai ;irications. 

It was mention: : zz'ivc ma: a method for matching CC and MLO images has 

been proposed by recr :: 'nc the user to locate corresponding microcalcifications in 
0 each of the images. H : ev^r, ; no ner aspect of the present invention provides a 

method of automatic . . de: :zi'..\g crresponding microcalcifications in two 
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mammograms of a br-j.^r. The two mammograms may be taken from different 
directions (such as the CC and MLO images), or may be using different imaging 
conditions such as tin:- of exposure or breast compression. The method is based on 
using the h iRt represent :ion of a mammogram explained in R. P. Highnam and J. M. 
5 Brady; "Mammograph:: Image Processing", Kluwer Academic Publishing, 1999, 
and also in the papers "Mammography Image Analysis" by Highnam, Brady and 
Shepstone; European Journal of Radiology 24 (1997) 20-32, and also "A 
Representation for Ma: .imo, Taenia Image Processing" by Highnam, Brady and 
Shepstone, Medical I:a.:ge Anaiys is 1996; 1:1-19. It will be recalled that in this 

10 representation the aia::. .r.ogram is convened into a representation in which for each 
pixel values h,„, and h f ^ : ire calculated representing the length of interesting tissue and 
length of fatty tissue tr.-ough which the X-rays pass to get to that pixel. Such values 
' can easily be convene :: intc a volume by multiplying by the area of the pixel. 
Thus another ar ;ect of the present invention provides for detecting 

15 corresponding microc:: . :ificaticns in two views by calculating such a. volume value 
v im for each microcalc! .'.cation in the two images. This is the sum of the h int values 
for that microcalcifica:. )n multiplied by its area. The values of v int for the 
microcalcifications in : e i .- o images are compared together, and those with the same 
or very similar value: . :' v ifm are :a.:en to be the same microcalcification. 

20 Preferably the v .icu.aticn c f the value \> ini includes the step of deducing the 

contribution of ncn-ca' "fisc tissue within the area of the image of the 
microcalcification. ir. .j.h^r wordi, because each value of h im is representative of a 
"pencil" shaped volur . c: \.ssuc extending from the pixel in the direction of the X- 
ray source, and the n.: : : .'. .if;: -ion is only a small part of that pencil, it is 

25 preferable to deduct ca ..ribu.l m of the remaining tissue in the "pencil". This 

contribution can con - ie. y b t estimated by locking at the h int value of tissue in the 
area surrounding tk : re -lc::V:ition. Because microcalcifications are small, the 
contribution of backs::.. . tissu; .vith:.: the image area of the microcalcification can 
be assumed to be the . .. . ■ ; th- .■ : nt value outside that area. Conveniently the . 

30 surrcundine area car ... ..::e« y dilating the image of the microcalcification and 
deducting ti:e area c. . ; ;roc.. tification itself. The values of h int in the 
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surrounding area car. t'- 


her be av 


eraged, or a plane fit can be made to them, or some 




other estimate based c 


:hose va! 


ues can be made. 








: be further described by way of non-limitative 




example with reference 


\o the acc 


:ompanying drawings in which:- 


5 


Figure 1 sen-err... 


-.ically illustrates two typical mammogram views; 




Figures 2 and : 


Hustrate 


a prior an process for reconstruction of a 3-D 




representation of the b 


is:; 






Figure 4 scherr. 


■icaily ii; 


urates the concepts used in the reconstruction 




process of an embocin 


:::: cf the 


present invention; 


10 


Figure 5 is a to;. 


v:-w cor; 


responding to Figure 4; 




Figure 6 schem \ 


.icaly ilii 


astrates other concepts used in reconstructions 




process of Figure 4; 








Figure 7 sche.T. -. 


•::r:!ly il!: 


urates two further mammogram views. 




Figure 8 illus*.:. 


^ 3 anoth- 


r aspect of the reconstruction process of the 


15 


embodiment of the pre . 


v: inven; 


;on; and 




Figure 9 illussn.. 


.-.3 the ma 


tching of microcalcifications in two mammogram 




views and the recons:r~ 


of the microcalcificacion in the 3-D representation. 




A first aspect c 


he inver. 


:i :-n is concerned with improving the process of ' 




reconstruct: ns a 3-D :t 


vntat: . 


. :. of an undefoimed object, such as the breast, from 


20 


two views of the defer 


;c ::bjec: 


Cor instance the two typical mammographic 




views). In the reconstr . 


:'. . a pre 


:ess discussed above with reference to Figures 2 




and 3 the compressea t 


?.:: out:; 


r.es in *he CC and MLO mammograms are equated 




with the three-dim ensic 


.econ- 


;:ructed breast outline. However, as the breast is 




placed upon and then : 


:-edbo 


■r.veen, the compression plate and the film-screen 


25 


cassette, the breast ec\. 


: ; ushe 


:rwards and outwards from the chest wall in 




order to ma: amis e xht 


. . bre- 


•:\ irei. Using the compressed outline in the 




reconstruction is ther;: 


. . .cor: . 


::. The first aspect of the invention is concerned 




with improving this pa 


. and ! 


.-. Volvos applying to the reconstruction process the 




constrain: that the :cm; 


.sad br; 


i23Z voiume V c should be approximately equal to 


30 


the uncompressed :.~ 




:ug>; the term "compression" is typically used in 




mammography, ir. fa: 


*. : e cc 


u..: cfX-mammography it refers to the 
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deformation of the br- st as the breast is squashed and does not imply reduction in 
volume in the physicr. :>ense. 

In order to app / the volume conservation constraint it is necessary to obtain 
the volume of the com -essed breast from the mammogram. This can conveniently 

5 be done from the CC ; age of Figure 1 A using the concept illustrated in Figures 3 
and 4. This schematic !ly illustrates a breast compressed between an upper 
compression plats 36 ;d the film-screen cassette 34. First the breast outline BO and 
the inner breast edge 1 E are detected in the CC mammogram. The inner breast edge 
is the curve on the ma: mogram where the compressed breast surface starts to fall 

0 from the compression ate and is illustrated as EBE in Figures 3 and 4. This can be 
detected as the h int = C ae wher. using the h lnt representation described above. The 
volume of a vertical s. e can iht:\ be found as illustrated in Figures 3 and 4 by 
summing for each sii: the volume of me rectangular region A and the approximately 
semi circuiar region E For a slice of thickness Scs the volume of region A is just its 

5 height multiplied by r__ -.victh: 

Aj x A 2 

The value A 2 i: qual to H, the compressed breast thickness, and this can 
either be noted when : ing the mammogram, or can be estimated by the techniques 
disclosed in R. P. Hie am and J. - A. Brady; "Mammographic Image Processing", 
0 Kluwer Academic Pu . : :h:ng, 15-99. The value A, can be measured from the 
mammogram. 

To estimate th . olume cf region B, me shape of the free edge 32 at the front 
of the breast between : : compression plate: 34, 36 needs to be estimated. 
Conveniently this i: -: .::.:ed ai b .inv: a fu:.:tion of B x and H. For example if it 
5 were assumed to be . ;:rcular :h m the cress sectional area of region B would be 
ti(H/2) : though in fac* : :; -drat;*: assumption provides a better estimate. - 

The \ jlume of ~ r.vo regions A and B are then just obtained as the cross 
sectional are:, multiple zy the y.lc: thickness ocs. 

The volume c: e ccmp:es:ed :rea:; can then be found by summing all of 
0 the slices ov:,r the w' * ■ as fo!'c vs: 
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cs 



It is then nee \ry to apply this estimated volume in the reconstruction 
process. In this emb .Trent the reconstruction process of Kita et al as described 
5 above is used with th lcdification that the breast areas in the CC and MLO image 
are each reduced by i . redetermined amount before being combined in the 3-D 
reconstruction. Conv ..- ieatly the predetermined amount is a circular structuring 
element of a certain p ius. One way to achieve this is to use the techniques of 
mathematical morph zy as detainee in the book by Serra. In particular 

10 mathematical morph . zy -introduces opera- ions such as erosion and the idea of a 
structuring element . has a characteristic shape and a size. One way to reduce the 
area of the breast is tc rode it using a circular structuring element of a suitable 
radius. It should be r : ed that the two areas in the CC and MLO images are not 
eroded by the same a: * ur.t because the amount of compression is generally different 

1 5 between the :wo ima. . Thus the ratio of the amount of erosion of the CC and 

MLO breast area is i: * ;seiy proportional to the ratio of their respective compressed 
breast thicknesses. F .: nstance if :he compressed breast thicicness in the CC view is 
5 cm and in the MLO r.v is 6 cm Lhen the amount of erosion ACC for the CC view 



20 



is related to the amoc z: erosion AMLO for the MLO view as follows: 



The ou:i:ues c " . ■ eroded t . :~. : area are used to form the 3-D reconstruction 

as in the prior art me: : end the vc ■ : .e of the reconstructed breast is calculated and 

25 compared to the com ss rd volume : . md above. The initial amount of erosion is 

chose:: so :ha: the vc e cf the rear paction will still be larger than the 

compressed volume. .:: the step:: c: erosion and reconstruction can be performed 

iteratively until :he rs - .Jtructed vclirme approximates the compressed volume. 

Erosion here refers tc . well-knov/r. :.chnique from mathematical morphology 
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detailed above. 

A second aspe : cf the inventic.- relates to parameterising the deformation of 

the breast. Breast ccr: session is a complicated process to model precisely because 

the deformation of th : breast depends not only on breast tissue composition, but also 
5 on how the radiograph :r positions the breast between the compression plate 36 and 

the film-screen casseu : 34. This means that mammograms of the same breast taken 

at two slightly differ*; . times are often very different. Even if the breast outlines BO 

and nipple positions L approximate in the two mammograms, the tissue will 

configure differently \ ::h different compression. The prior art reconstruction 

10 process of Kita et al rv. rationed above does not take into account variations in the 

compression process s given two identical breast outlines and nipple positions in 

two views, the recon:: icted breast wii! always be the same. The second aspect of 

the present invention : volves incorporating the following parameters as a model of 

the deformation procj. : 

15 

• transl: on in the x-di: ection (f x ) 

/ x - refer: ; the shift of breast tissue in the x-direction, i.e. the direction 

perper c :ular to the chest wall, as the breast is compressed. 

• local : . : . ;ion angle (0/ 

20 6 r cea. : : :h the amour/, of local rotatipn of some anatomical 

struct 1 ..: : about a fixed r.oint in the surroundings as the breast is 

comp: . :d. In our caj c, it is the local rotation of a microcalcification 

about \\ - centre id of the cluster. 

• jki.; s . hing paran: in CC compression (y^) 

25 s cc . .. die amount c : breast surface being squeezed between the 

con.pi . .n place and fiim-screen cassette. Effectively, s cc 

centre . \iere a poir.: c : the breast surface maps to on the 

comp;-:. i ou:;ine a:.c \\s in turn determines the curvature of the 

res-lti . r. co:: - presst c curve. 

30 • ;k.\: s : ing paran. v.. jr in MLO compression (s AfLO ) 

: i: iLO equiva- .nt of s cc under CC compression. 
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The parameter model is illustrated in Figure 6. 
These param*:.: . s are set as described in a later section using ground 
truth/known matche: : :;i :he image pair. These optimised parameter values are 
then used to determine .he 3-D position of the remaining calcifications. 
5 The third as pec. of the invention relates to a method of matching 

microcalcifications f: c n two mammographic views, in which enables the production 
of a three-dimension : instruction of the microcalcification cluster. In order to 
achieve this the dete*:;-. . microcalcifications in the two views have to be matched up. 
Figures 7A and 3 sci.t ..ticaiiy illustrate the CC and MLO images respectively of a 
10 breast including a m: calcification cluster 60. As discussed above the existing 
stereo vision techniq-st. -re not suitable for matching microcalcifications in such 
views because of the z .ticuiarly wide angle between the CC and the MLO views in 
breast mammograms v * :h gives a grea: deal of "correspondence" ambiguity 
between the two viev ; " his aspect of the present invention matches the 

15 microcalcifications i: : ". :e a differ ent way based on the h inl representation of the 
mammogram discus: ^ icove. In fact the h int values are converted into a volume 
representative value v ir vhich represents the volume of "interesting tissue" within the 
calcification region. ? ...use \> ini is a normalised quantity, the same calcification 
should have apprcxi: : y the same vai :e of the v int under any variation in the 

20 imaging process, be : % ectiun, tir.te-cr-exposure or breast compression. 

It will be rec:.i: th:.t me vLue oi h iHt represents the amount of interesting 
tissue in a penci: vo*. r through the breast with the base of the pencil being the 
pixel in the mammc - :i s &. t penci. extending towards the X-ray source. Thus for 
image pixels within : . of a rr.ijrocicification, although only microcalcification 

25 is visible in the Lv.a ; .. . - :en; .. vo' :ne of tissue contributing to this pixel will 
include not the r.itr; .: i. nation u . : a.:o other interesting tissue above and below it. 
In order to isolate th- : ; :alcif: : :;on it is necessary to remove the contribution of 
the other interesting ... :. /hus t.. . vaiue v iM (which is obtained from h int by 
multiplying h int by i ■■ 'the p:.:el p : ) needs to be calculated as> 

30 

■.Jc+surr surr 

* . = ' , ~~ v , 

mt 
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Where V*^**" is based c:\ the total sum of all h int values of all pixels within 
the area of the microc: :ification which include the contribution of the calcification 
plus mat of the backg: nd :issue. is the interesting volume of just the 

background tissue. 

5 To estimate the :oatribution of the background tissue it is assumed that the 

background tissue is th same as the tissue in the immediate surroundings of the 
microcalcification. Tr. " by lookir.v. at ar. image area surrounding the 
micrc calcification, va: s of h inl can be obtained from them, for instance averaged. 
This area is obtained i: his embodiment by looking at a dilated region around the 

10 calcification region, a:, subtracting from the dilated region the area of just the 

calcification. In fact fc- ause micrc calcifications are small, the assumption that the 
conu-ibution of backgr. :nd tissue within the area of the microcalcification is equal to 
the vaiue from backgr. nd tissue c ^tside the area of the microcalcification is 
reasonable. Figures $.- o SO illustrate the relationship between the 

15 microcalcification rag; . So and dilated region 84. It can be seen from Figures 8B 
to SD that the microca. fication gives rise to a peak 80 in the value of h inr This is 
superimposed on a bac ground alue 32 of h int which is approximately constant. 
What is wanted is the iume of the peak SO without the substantially constant base 
level S2 i.e. the shaded . :gicn in Fuure SB. In the h in} representation from the 

20 mammogram the valu _ ' k irA witnir. the microcalcification consists of the shaded 

region shown in Figure C, i.e. the sum of the two. By looking at the h iM value of the 
pixeis outside the peak .e. in the di : .atec region 84 in Figure 8D, and subtracting 
those pixels within :he lcrcca!.:[fu\itior: region (the region 86), the background 
value S2 of h ini can be - imacec. T. :s car. then be removed from the value within the 

25 microcalcincatic. re^ T : . Mathe.n ".icaliy, 
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where / is the r 
number of pixels with - 



:ixe! of the calcification region; p is the pixel size; N c is the 
he calcification region; and 



K7 = Iu,,, h int Q)/N d/ 



10 



Where N d/C is ; 
denote the dilated rc_ _ ■. 

. It should be nc 
number of other ways, :c 

Having calcuia::. 
views, a match score J : . 
the values from each c . 



jmber of zixz.< in just the dilated region and r d and r c 
.:;d calcification region respectively, 
however, that the background value can be estimated in a 
instance with :: plane fit rather than an average, 
the value v,„, f;r each microcalcification in each of the two 
: be computed to indicate the goodness of the match using 



V v , + V 



15 

where v cc and ■ 
CC and MLO view res 
match having a. score c *~ 
Thus this rr.eth 
20 views to be matched u : 
combined with the pa. 
reconstruct a three-di:. . 
this the match score :\ 
MLC images is ccn:;:„ . . 
25 v /m ) are retained as zz: . . 
9 A. Knowing that . 
two views, they can b 
For each of th- 



?se the v /? ,v2/.:es of a calcification region detected in the 
:'vely. The values of S range from [0, 1] with a perfect 

"ows microc. :ifications detected in each of the two 

:: denoted as corresponding to each other. If this method is 

jrised deformation model above, it is possible to 
ijnal mccei o. the cluster of microcalcifications. To do 

possible pdi:: of calcifications detected in the CC and 

and those • with low match scores (i.e. with similar 
:.t .natch^s as i.ustrated by microcalcification 90 in Figure 
.zrocaIcif:ca:i.:-::s correspond to each other between the 

: to fixec the :et of parameters in the deformation model, 
.nfident maicr.ts, two uncompressed curves 92, 94 as 
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shown in Figure 9B .n j •» genera:ed ir. the 3-D uncompressed breast, one for each of 
the CC and MLO cc::\;;:^sion. The se: of compression parameters are then chosen 
such that the uncomp:.: red curves 92, 94 of each confident match intersect, or are 
closest to each other. ... .: djf) be :he nearest distance between the CC and MLO 
5 uncompressed curve; :he /th confident match. The minimisation problem can be 
written as: 



: «, - 1,4,(0 

* ■ y. 

Once the con. rlon pari met-:-, s are fixed, the rest of calcifications in the 
10 two views are match • : ■. " such th-: th* uncompressed curves of each matched pair 
either intersect or ar: :! : * -.:t to ea:h ct! er. 

The final 3-D /.ion of z "cation 90 in the uncompressed breast is 
taken as the intersect: ■ ~. -sclnt of the uncompressed curves 92, 94 or the mid-point 
between the closest pc :. ■ - on the r.vo u:. compressed curves of a matched pair as 
15 shown by point 96 in \ .re ?B. 
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C LAIMS 

I. A metho of producing a three dimensional representation of an 
5 undeformed object by c \mbining information from two images taken from different 
viewpoints of the object under deformation, estimating the volume of the deformed 
object, and constraining the three dimensional model of the object to have 
substantially the same volume. 

10 2. A metho according to :!aim 1 wherein the deformation of the object 

differs between the tv-'o mages. 

3. A meiiic J according to ihaim 1 or 2 wherein the volume of the 
deformed object is esiirr. ated from one of the images. 

15 

4. A met! j . according to claim 3 wherein the volume of the deformed 
object is estimated by .nmxng over the image the volume of slices of the object 

" parallel to the imaging ejection. 

20 5. A meti.e-.: according to claim 1, 2, 3 or 4 wherein the volume is 

estimated by assumir. ; : : heast par. of the surface of the deformed object to be a 
parametric surface. 

6. A me:! ? .. acording to : ny one of the preceding claims wherein the 
25 information from each c ' :he two images is combined by the steps of: (a) detecting 
the outline of the obj^a: hi each of the two images, (b) reducing area of the outlined 
areas by a predetem;: . : ;.moun: and ( :) using the outlines of the reduced areas as 
prcf.les from dirTeren ections of the three dimensional representation of the 
object. 



30 
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7. A me:! ;: according to claim 6 funher comprising the steps of: (d) 
calculating the volum ; of the three dimensional representation of the object, (e) 
comparing it to the es *.:nated volume of the deformed object, and iterating steps (b), 

5 (c), (d) and (e) until t\ • volume of the three dimensional representation of the object 
is substantially equal *. :he estimated volume of the deformed object. 

8. A met: . . . according to claim 6 or 7 wherein the three dimensional 
representation of the c .Jsc: comprises parametric surfaces passing through the said 

10 profiles. 

9. A met: : according to claim 6, 7 or 8 wherein the outlines of the 
reduced areas are use" \ ; profiles from orthogonal directions. 



15 10. Ameth 

of deformation of the :. 
amounts by which the 
accordance with the r^ 



i according to cany one of claims 6 to 9 wherein the amounts 
■;ect differs between the two images and the predetermined 
*..:lined areas are reduced in the two images differ in 
:ative amounts of deformation. 



20 11. A met: ■ acording to any one of the preceding claims wherein the 

object is deformed par ;o one of the imaging directions. 



25 



12. A metl- 
object is deformed by 

13. A metl 
ob'ect is a human brea 



i :cording to any one of the preceding claims wherein the 
.pressicn. 

.^aorc::.g to any one of :he preceding claims wherein the 



14, A me:: . :ordi:-.2 to ciaim 13 wherein the images are breast 



30 mammograms. 



WO 01/69533 



PCT/GB01/00414 



-17- 



I5. A me:! 
cranio-caudal (CC) ar. 
medial. (LM) views. 



: according to claim 14 wherein the images are taken in the 
r.edio-lateral oblique (MLO) directions or .CC and lateral- 



16. A me:!. : according to claim 15 wherein the volume of the deformed 
breast is estimated frc :he CC or MLO or LM image. 



17. A me:, 
undeformed object b> 
1 0 viewpoints of the obj l 
the object in terms o: 
object, the rotational : 
the surface under the ■.' 



of producing a three dimensional representation of an 
.mbining information from two images taken from different 
. :nder deformation and parameterising the deformation of 
jist one of: the linear displacement of the interior of the 
iacement of the interior of the object, and the stretching of 
'■sanation. 



15 13. Ame:. 

differs between the tv- 
surface is calculated ; . 



according to claim 17 wherein the deformation of the object 
nages and a parameter representing the stretching of the 



ich of the images. 



.19. A me:'.: 
20 corresponding image 
parameters to bring t. . 
dimensional represe: 



according to claim 17 or IS further comprising detecting 

:ies in the two images and setting the deformation 

j [responding image entities into registration in the three 

i ofi:.t unde:brmed obiect. 



20. A me:. according to claim 17, 18 or 19 wherein the object is a 
25 human b: ^ast. 



21. A me. 
mammc :;ams. 



icccrJing u aiaim 20 wherein the images are breast 



30 22. Ame: 

the cranio -caudal (Q 



iccc: ing to claim 20 or 21 wherein the images are taken in 
d meoio-Iataral oblique (MLO) directions or cranio-caudal 
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23. A me' of deleting correspondences between microcalcifications 

in r-vo mammogram: c z brea :: by converting the two images into an h int 

5 representation repre: r : .::g the ::iickr.-:sses of interesting tissue and fat in regions of 

the breast contributir. . > the mammograms, calculating a value v ira representing the 

interesting volume r\ :h mi ;rocalc:f:cation based on a sum of the values of h int for 

all pixels within the : : e of the micrjcalcification, comparing the values of v int for 

each microcalcificat! : one .:nage with each rnicrocalciflcation in the other image 

10 to detect as correspo. : . ; tho: - whe: :: v in{ values match to a predetermined degree. 



15 



14. A me. 
v int for each microcai . 
the microcalcificatio 

25. A me /. 
value v int for each mi t 
non-calcified tissue •. 



accor-ing tc :iaim 23 wherein the calculation of the value 
..don ;ompri:-$ summing for all pixels within the image of 
value of h ;n . multiplied by the area of the pixel. 

icco: . ing t: :!aim 23 or 24 wherein the calculation of the 
alcinc-tion farther comprises deducting the contribution of 
: the : : ea of : e image of the rnicrocalciflcation. 



20 26. A me' 

calcified tissue is est" 
surrouncing the mic; 



xcor .ing ::aim 25 wherein the contribution of non- 
d or. :e bai : : of the value of h int in the area of the image. 

;ific:.\;n. 



17. Ame 
25 calcified tissue is est' 
of the imase surroun 



.ceo: ing t; .'.aim 25 wherein the contribution of non- 

d on :he bai' ; of the average of the value of h int in the area 

.he r: :roc.:i..:;"i cation. 



28. A me 
non-calcified tissue i 
30 imagi surrounding 
multLwine the valu-. 



.ccc. . ing i. :;aim 25, 26 or 27 wherein the contribution by 
:ula: . by c verting the value of h.„ t in the area of the 
:roc: :inc:.. . a into a vjlunie representative value by 
: lnt fc each : ..<el in the sun funding area by the area of 
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each pixel and the nt 

29. A me: 
image entities are m: 
5 any one of claims 23 

50. A me: 
parametrising the de 
on of ciiims 17 to 22 

10 

3 1. Aeon: 
perforir, the method c 

32. Acorn 
15 claims I :o 30. 

33. Amet 
referer. : : to and as ill 
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er of pixels ir. the surrounding area. 

: acco: iing to claim 20, 21 or 22 wherein the corresponding 
ilcifications detected as corresponding by the method of 

according iz any one of claims 1 to 16 further comprising 
nation of the object in accordance with the method of any 

;r- program comprising program code means adapted to 
:y one of the preceding claims. 

t syst ;m programmed to perform the method of any one of 

or sys:em substantially as hereinbefore described with 

r id ir. the accompanying drawings. 
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